Skip to content

Feature/ramp#39

Open
AbdelrahmanKatkat wants to merge 19 commits intomasterfrom
feature/ramp
Open

Feature/ramp#39
AbdelrahmanKatkat wants to merge 19 commits intomasterfrom
feature/ramp

Conversation

@AbdelrahmanKatkat
Copy link
Copy Markdown
Contributor

Testing CI Pipeline

AbdelrahmanKatkat and others added 7 commits March 1, 2026 23:54
…mantic segmentation model

- Introduced Dockerfile for building the RAMP model environment with GPU and CPU support.
- Added pipeline.py for defining the ZenML pipeline, including preprocessing, training, inference, and postprocessing steps.
- Created README.md to document the model architecture, usage, and data layout.
- Implemented stac-item.json for STAC catalog integration.
- Included smoke tests to validate the Docker runtime and model functionality.
- Updated .gitignore to exclude new data directories.
… loading

- Updated pipeline.py to load hyperparameters from STAC Item JSON, streamlining model configuration.
- Modified training_pipeline to accept a path to the STAC Item, allowing for flexible hyperparameter management.
- Revised README.md to reflect changes in hyperparameter handling and usage of STAC Item.
- Enhanced stac-item.json with additional metadata and structure for better integration.
- Removed outdated CODE_EXPLAINED.md and README.md from tests directory to clean up documentation.
… and compatibility

- Refactored Dockerfile to streamline the build process, using a base image from GHCR for both CPU and GPU.
- Enhanced pipeline.py to support new model weight loading mechanisms and improved error handling for model paths.
- Updated README.md to reflect changes in framework version and model usage, including new data directory structure.
- Revised stac-item.json to include updated model weights source and additional metadata for better integration.
- Improved smoke tests to validate the new pipeline functionality and ensure compatibility with the latest TensorFlow/Keras versions.
- Added per-file ignores in Ruff for specific linting rules in pipeline.py.
…improvements

- Added functions to resolve local and remote input directories and files, improving flexibility in handling model paths.
- Implemented a zip extraction utility for loading models from compressed files.
- Updated `resolve_model_href` to support both local and remote SavedModel directories, enhancing compatibility with various model formats.
- Modified smoke tests to validate the new `split_dataset` functionality alongside training wrappers, ensuring robust model training and validation.
… and dependencies

- Refactored Dockerfile to separate build, runtime, test, and inference stages for better clarity and efficiency.
- Updated `pyproject.toml` to remove unnecessary lint ignores.
- Enhanced `pipeline.py` with improved model resolution and added support for lazy imports.
- Revised README.md for clarity on architecture and usage.
- Added test fixtures for a toy dataset and implemented step tests for the RAMP pipeline.
- Updated STAC item schema to version 1.1.0 and included additional metadata properties.
@codecov
Copy link
Copy Markdown

codecov Bot commented Apr 21, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 97.62%. Comparing base (f90e121) to head (4cebc65).
⚠️ Report is 13 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master      #39      +/-   ##
==========================================
- Coverage   98.05%   97.62%   -0.44%     
==========================================
  Files          42       43       +1     
  Lines        3807     3911     +104     
==========================================
+ Hits         3733     3818      +85     
- Misses         74       93      +19     
Flag Coverage Δ
fair 96.70% <ø> (-0.66%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

…ources

- Refactored model resolution logic in `pipeline.py` for clarity and efficiency.
- Updated `pretrained_source` and `checkpoint` URLs in `stac-item.json` to point to Hugging Face.
- Adjusted metadata properties in `stac-item.json` for consistency and accuracy.
- Simplified the `resolve_model_href` function to focus on .onnx and .zip formats.
- Improved error handling for unsupported model formats and missing files.
- Updated ZIP extraction logic to ensure proper directory creation and cache management.
- Removed deprecated code and comments for better readability.
…ipeline.py

- Consolidated multi-line string definitions into single lines for consistency.
- Removed unnecessary blank lines to enhance code clarity.
- Streamlined parameter retrieval in several functions for better readability.
…TAC item references

- Removed the default baseline URL in `pipeline.py` and raised a ValueError if weights are not provided.
- Updated `pretrained_source` and `checkpoint` URLs in `stac-item.json` to point to the new Hugging Face location.
- Adjusted the `create_toy_data` function to ensure it uses a GeoJSON file for labels, aligning with the expectations in `pipeline.py`.
…peline.py

- Updated type hints for several functions to use Optional and Union for better clarity.
- Introduced a new function `_normalize_to_savedmodel_dir` to streamline model path normalization.
- Improved error handling and readability in model resolution and checkpoint restoration logic.
- Consolidated ZIP handling and model loading processes for better maintainability.
… unused cache function; update hyperparameters specification in stac-item.json
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant